Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies

نویسندگان

  • Angélique O. J. Cramer
  • Don van Ravenzwaaij
  • Dora Matzke
  • Helen Steingroever
  • Ruud Wetzels
  • Raoul P. P. P. Grasman
  • Lourens J. Waldorp
  • Eric-Jan Wagenmakers
چکیده

Many psychologists do not realize that exploratory use of the popular multiway analysis of variance harbors a multiple-comparison problem. In the case of two factors, three separate null hypotheses are subject to test (i.e., two main effects and one interaction). Consequently, the probability of at least one Type I error (if all null hypotheses are true) is 14 % rather than 5 %, if the three tests are independent. We explain the multiple-comparison problem and demonstrate that researchers almost never correct for it. To mitigate the problem, we describe four remedies: the omnibus F test, control of the familywise error rate, control of the false discovery rate, and preregistration of the hypotheses.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An introduction to Multiway Methods for Multi-Subject fMRI experiment

Model free exploratory methods available for functional MRI analysis of one subject such as Principal Component Analysis (PCA) and Independent Component Analysis (ICA) are investigated for generalisations when analysing more than one subject. Introducing the subject dimension makes a three-way data: brain, time, subject, and multiway methods are proposed either to optimise the variance (PCA) or...

متن کامل

Costs of Quality: Exploratory Analysis of Hidden Elements and Prioritization using Analytic Hierarchy Process

Cost of Quality analysis is emerged as an effective tool for the industrial managers for pinpointing the deficiencies in the system as well as for identifying the improvement areas by highlighting the cost reduction opportunities. However , this analysis will be fully effective only if it is further extended to identify the cost incurred in ensuring quality in all areas of the supply chain incl...

متن کامل

Multiway frequency analysis for experimental psychologists.

Many research designs in experimental psychology generate data that are fundamentally discrete or categorical in nature, and produce multiway tables of frequencies. Despite an extensive and, more recently, accessible literature on the topic, multiway frequency analysis is rarely used in experimental psychology. A reason may be the form of exposition in the literature, with emphases and concerns...

متن کامل

Unilateral Hearing Loss: Prevalence, Causes, Consequences and Available Remedies

Introduction: The prevalence of unilateral sensory neural hearing loss is 3 to 6 in every 1000 people and this prevalence will be about 3 to 5 percent by including conductive hearing loss. Studies have shown that people with unilateral hearing loss are having problems in speech and language development. Nowadays the available options for treatment and rehabilitation of people with unilateral he...

متن کامل

Similarity Component Analysis

Measuring similarity is crucial to many learning tasks. To this end, metric learning has been the dominant paradigm. However, similarity is a richer and broader notion than what metrics entail. For example, similarity can arise from the process of aggregating the decisions of multiple latent components, where each latent component compares data in its own way by focusing on a different subset o...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره 23  شماره 

صفحات  -

تاریخ انتشار 2016